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CHAOS  Success  rate  definitions 
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<?urrp«s«t  ■  Produced  acceptable  results 

delivered  close  to  on-time 
and  on-budget 


■  Challenged  ■  Delivered  software  product 

significantly  over  budget 
and/or  schedule 


■  Failed  ■  Failed  to  deliver  any  usable 

result  within  budget  or 
schedule  constraints 
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Software  problems  are  not  new 
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■  Unreliable 

■  Late  delivery 

-  Modification  costs  prohibitive 

■  Impossible  to  maintain 

-  Inadequate  performance 

-  Product  exceeds  budget  costs 

CS  Conference,  Munich,  Germany 
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Reasons  for  project  failure 
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ADVERTISED 

■  Immature  technology 

■  Inadequate  requirements 

■  Insufficient  developer  experience 

COVERT 

■  Poor  estimating  and  planning 
-  Hope  (Pandora’s  paradox) 
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Repeatable  things 


■  Development  environment 

■  Productivity 

■  Minimum  development  time 

■  Effective  product  size 

■  Complexity 

■  Paul  Masson  rule 


Let’s  look  at  some  proof 
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BIG  productivity  drivers 
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■  Analyst  capability 

■  Management  style 

■  Motivation 

■  Problem  solving  skills 

■  Use  of  team  methods 

■  Working  environment 

■  Application  domain  experience 

■  Automated  tool  support 

■  Programmer  capability 

■  Use  of  modern  practices 
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Capability  shift  (environment) 
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1996/2003  Productivity  for 
and  Unmanned  Space 
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..progressed  at  LESS  THAN  this  rate  in  lines/developer-months 

1996  graph  based  on  52  Mil-Spec  Avionics  &  Unmanned  Space  Software  Data  Records 
2003  graph  based  on  51  Mil-Spec  Avionics  &  Unmanned  Space  Software  Data  Records 


Aerospace  Corp  -  Long  etal  2004 
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1996/2003  Productivity  Distributions 
for  Ground  and  Mobile 
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...progressed  at  LESS  THAN  this  rate  in  lines/developer-months 

1996  graph  based  on  1 12  Military  Ground  &  Military  Mobile  Software  Data  Records 
2003  graph  based  on  135  Military  Ground  &  Military  Mobile  Software  Data  Records 


Aerospace,  Long  et  al,  2004 
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Common  technology  claim 
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If  you  use  ( new  technology), 
Productivity  will  improve  by  an  order  of  magnitude 

And 

Defects  will  reduce  to  zero 
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There  is  always  HOPE 
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Where  would  you  focus  effort? 
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Source:  G.  Weinberg,  Quality  Software  Management,  Vol.  3 
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Relative  payoff 
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Source:  G.  Weinberg,  Quality  Software  Management,  Vol.  3 
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Repeatable  things 
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■  Development  environment 

■  Productivity 

■  Minimum  development  time 

■  Effective  product  size 

■  Complexity 

■  Paul  Masson  rule 


Let’s  look  at  more  proof 
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Historic  project  data 
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Source:  Long ,  L.  G.  et  al,  2004 
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Size  (ksloc) 


Historic  space  project  limits 
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Time 


Source:  Long,  L.  G.  et  al,  2004 
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Three  development  variables 
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Cost 

Schedule 

Scope 


YES  YOU  WILL 
YOU  WILL  PUT  IT 
IN  THE  PLAN,  FORGET 
WE  HAD  THIS 
CONVERSATION,  AND 
EIRE  ME  WHEN  I  GO 
_ OVER  BUDGET. 


IF  YOU 
ALREADY 
KNOW  THE 
COST,  WHY 
ARE  YOU 
^VSKING  ME? 


/ - 

DONT  WORRY.  I 
WON'T  HOLD  YOU 
TO  THE  ESTIMATE, 
V _ I  r - n— - 


GIVE  ME  A  NUMBER 
OR  I'LL  FIRE  YOU 

FLIGHT  NQLJ.  , 


I  NEED  A  COST 
ESTIMATE  ON 
YOUR  PROJECT. 


f - 

SO  YOU1L 

FEEL  LIKE 
YOU  HAD 
INPUT. 


THAT'S 


I  UU 


HIGH 


f  \ 

I  HAVE  NO  IDEA. 

I  HA  VENT  EVEN 
GATHERED  THE  USER 
REQUIREMENTS 


- - 

OKAY,  IT  WILL 
COST  TEN  MILLION 
DOLLARS. 


E>  Scott  Adams,  InC./DtSt.  by  1JF$,  ln£. 


Developer  can  control  any  two 
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Historic  note: 
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"More  sof tware  projects  have 
gone  awry  for  lack  of  calendar 
time  than  for  all  other  causes 
combined..." 


F.  P.  Brooks,  Jr.,  Mythical  Man  Month 
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Common  estimate  dilemma 
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THE  REVISED 
SCHEDULE  IS 
THIS. . . 


NOUI  SCRATCH  ONE 
OF  THESE  SCENTED 
CARDS  TO  SNIFF 
THE  UNMISTAKABLE 
ODOR  OF  DOOM. 


ONE  YEAR  OF  INDECI¬ 
SION  FOLLOWED  BY 
INTENSE  PRESSURE 
TO  DO  THE  IMPOSSI¬ 
BLE  BEFORE  THE 
DEADLINE 

Ss: 


©  2002  United  Feature  Syndicate,  Inc 
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Constraint  analysis 
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■  Success  and  failure 

determined  by 

■  Expected  cost  and  schedule 

determined  by 


Project  plan 

determined  by 

Cost  and  schedule  ESTIMATES 

determined  by 

Managers  and/or  Estimators 
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Key  estimate  factors 


OGDEN  AIR  LOGISTICS  CENTER 


BE  AMERICA  ’S  BEST 


/■< 


Elements  for  successful 

estimates 
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■  Basic  understanding  of  the  requirements 

-  Ability  to  accurately  size  the  deliverable  product 

■  Assessment  of  the  deliverable  complexity 

-  Profile  of  the  organization’s  delivery  capability 
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Estimates  are  important 
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Without  well  thought  out  estimates,  there  is  no  firm 
basis  for: 

■  Defining  costs  and  schedules 

■  Making  tradeoffs 

■  Associating  development  costs  with  the  benefits 

■  Conforming  to  a  budget  or  schedule 

■  THE  PROJECT  IS  ALREADY  OUT  OF  CONTROL! 
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Project  success  rate 
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CHAOS  2004  Software  Project  Survey 
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Success  definitions:  2nd  look 
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■  Success 


-  Challenged 


-  Failed 


Produced  acceptable  results 
delivered  close  to  on-time 
and  on-budget 

Delivered  software  product 
significantly  over  budget 
and/or  schedule 

Failed  to  deliver  any  usable 
result  within  budget  or 
schedule  constraints 
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Conclusions 
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■  Software  project  failures  are  primarily  due  to  failed 
expectations 

■  Technology,  requirements  and  experience  are  largely 
accounted  for  in  resource  estimates 

■  Failure  ranking: 


i.  Poor  estimating  and  planning 


2.  Hope  (Not  a  management  strategy) 

3.  Immature  technology 

4.  Inadequate  requirements 

5.  Insufficient  developer  capability  (Ebonians) 
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New  estimating  models? 
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■  Lack  of  confidence  in  existing  tools 

■  Optimistic  estimates 

■  Unacceptable  estimates 

•Skill 


•  Experience 
•Integrity 


■  Aging  tools 

■  Quality  data 

■  Culture  is  constant 

■  New  models  require  validation 

■  Silver  bullet 

■  New  estimators? 
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Historic  note: 
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We  learn  from 
experience  that 
we  don't  learn 
from  experience. 

D.  H.  Lawrence 
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The  End, 

or 
is  it 

The  Beginning? 

(History  does  repeat  itself) 
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